Evaluation of Short-Range Depth Sonifications for Visual-to-Auditory Sensory Substitution

نویسندگان

چکیده

Visual-to-auditory sensory substitution devices convert visual information into sound and can provide valuable assistance for blind people. Recent iterations of these rely on depth sensors. Rules converting (i.e., the sonifications) are often designed arbitrarily, with no strong evidence choosing one over another. The purpose this article is to compare understand effectiveness five sonifications in order assist design process future visual-to-auditory systems people, which frequency, amplitude, reverberation as well repetition rate short high-pitched sounds signal-to-noise ratio a mixture between pure noise studied. We conducted positioning experiments 28 sighted blindfolded participants. Stage 1 incorporates learning phases followed by estimation tasks. 2 adds additional challenge azimuth first stage's protocol. 3 tests retention incorporating 10-min break before retesting estimation. best estimates stage were obtained frequency beeps. In 2, beep yielded estimation, significant difference was observed Results showed that easiest sonification memorize. Based statistical analysis results, we discuss each other studies encode sounds. Finally, recommendations encoding.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution

Sensory Substitution Devices (SSDs) convey visual information through sounds or touch, thus theoretically enabling a form of visual rehabilitation in the blind. However, for clinical use, these devices must provide fine-detailed visual information which was not yet shown for this or other means of visual restoration. To test the possible functional acuity conveyed by such devices, we used the S...

متن کامل

Flexibility and Stability in Sensory Processing Revealed Using Visual-to-Auditory Sensory Substitution

The classical view of sensory processing involves independent processing in sensory cortices and multisensory integration in associative areas. This hierarchical structure has been challenged by evidence of multisensory responses in sensory areas, and dynamic weighting of sensory inputs in associative areas, thus far reported independently. Here, we used a visual-to-auditory sensory substitutio...

متن کامل

Seeing with sound? exploring different characteristics of a visual-to-auditory sensory substitution device.

Sensory substitution devices convert live visual images into auditory signals, for example with a web camera (to record the images), a computer (to perform the conversion) and headphones (to listen to the sounds). In a series of three experiments, the performance of one such device ('The vOICe') was assessed under various conditions on blindfolded sighted participants. The main task that we use...

متن کامل

The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms.

Sensory substitution is a promising technique for mitigating the loss of a sensory modality. Sensory substitution devices (SSDs) work by converting information from the impaired sense (e.g., vision) into another, intact sense (e.g., audition). However, there are a potentially infinite number of ways of converting images into sounds, and it is important that the conversion takes into account the...

متن کامل

How well do you see what you hear? The acuity of visual-to-auditory sensory substitution

Sensory substitution devices (SSDs) aim to compensate for the loss of a sensory modality, typically vision, by converting information from the lost modality into stimuli in a remaining modality. "The vOICe" is a visual-to-auditory SSD which encodes images taken by a camera worn by the user into "soundscapes" such that experienced users can extract information about their surroundings. Here we i...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Human-Machine Systems

سال: 2023

ISSN: ['2168-2291', '2168-2305']

DOI: https://doi.org/10.1109/thms.2023.3265972